Web Survey Bibliography
In the last six years I have led projects aimed at developing software that learns how to code open-ended survey data from data manually coded by humans. These projects have led to the development of software now in operation at the Customer Satisfaction division of a large international banking group, and now integrated into a major software platform for the management of open-ended survey data. This software, which can code data at a rate of tens of�thousands of responses per hour, is the result of contributions from different fields of computer science, including Information Retrieval, Machine Learning, Computational Linguistics, and Opinion Mining. In this talk I will discuss the basic philosophy underlying this software, I will present the results of experiments we have run on several datasets of respondent data in which we compare the accuracy of the software against the accuracy of human coders, and I will argue for a notion of "accuracy" defined in terms of inter-coder agreement rates. Finally, I will discuss the kind of characteristics that make a survey more or less amenable to automated coding by means of our system.
Homepage (abstract)/(presentation)
Web survey bibliography (4086)
- Machines that Learn how to Code Open-Ended Survey Data: Underlying Principles, Experimental Data, and...; 2008; Sebastiani, F.
- Computer coding of 1992 ANES Like/Dislike and MIP responses; 2008; Fan, D. P.
- CATA (Computer Aided Text Analysis) Options for the Coding of Open-Ended Survey Data; 2008; Skalski, P.
- Classifying Open Occupation Descriptions in the Current Population Survey; 2008; Conrad, F. G., Couper, M. P.
- Coding Responses Generated by Open-Ended Questions: Meaning Matching or Meaning Inference?; 2008; Potter, Ji.
- Open-ended questions and text analysis; 2008; Popping, R.
- Coding Verbal Data - What to Optimize?; 2008; Krippendorff, K.
- An evaluation of the weighting procedures for an online access panel survey; 2008; Loosveldt, G., Sonck, N.
- The adequacy of response rates to online and paper surveys: what can be done?; 2008; Nulty, D. D.
- Validity of an On-Line Panel Approach to Citizen Surveys; 2008; Van Ryzin, G. G.
- Internet dating: a British survey; 2008; Gunter, B.
- Survey of Web Developers in Academic Libraries ; 2008; Connell, R. S.
- Online vs. face-to-face discussion in a web-based research methods course for postgraduate nursing students...; 2008; Campbell, M., Gibson, W., Hall, A., Richards, D., Callery, P.
- Using Web 2.0 to Conduct Qualitative Research: A Conceptual Model ; 2008
- Testing telephone and web surveys for studying men's sexual assault perpetration behaviors ; 2008; DiNitto, D. M., Busch-Armendariz, N. B., Bender, K., Woo, H., Tackett-Gibson, M., Dyer, J.
- Integrating Qualitative and Quantitative Research Methods: Uncovering Emotional Drivers From Qualitative...; 2008; Reid, Aa.
- Mobile Research: Five Ways To Collect Data Using Mobile Devices; 2008; Conry, S.
- Best Practices For Identifying Duplicate Respondents; 2008; Ouren. J., Dickie, W. J., Chokeir, N.
- Engaged Respondents Are Better- Innovative Techniques To Improve Response; 2008; Sleep, D.
- Analytic implications of panel data quality; 2008; Harlow, B.
- Measuring the value of respondent engagement; 2008; Puleston, J., Sleep, D.
- Pavlov revisited; 2008; De Wulf, K., Friedman, M., Borggreve, B.
- Between random samples and online panels; 2008; Crassweller, A., Rogers, J.
- Digital moms; 2008; Wilbur, C. Rimmer, L.
- Research Instruments: Driving e-Science? ; 2008; Schroeder, R.
- The US Institutional Review Board and Online Research Ethics; 2008; Markham, A., Buchanan, E. A., Ess, C.
- Getting animated about emotion; 2008; Penn, D.
- Can online panels be truly global?; 2008; Shashkin, A. V.
- Digital video at the service of research; 2008; McClure, S., Renard, M. C.
- Realism in research; 2008; Richarme, M., Colias, J.
- What Can We Achieve With 5 Euros? Optimization of Survey Data Quality Using Mixed-Mode Approaches; 2008; Berzelak, N., Vehovar, V., Lozar Manfreda, K.
- Measuring Non-Response Cross Nationally; 2008; Blom, A. G.
- Use of a website to evaluate quality of work-life and quality of life among community workers helping...; 2008; Dupuis, G.
- Comparing the network structures in teams among companies: Extensions of the MTML approach; 2008; Agneessens, F., Contractor, N.
- Online poll in study of incentives to participation of youth in innovative development; 2008; Gvozdeva, E. S.
- Measuring ties on online forums; 2008; Ziberna, A., Vehovar, V., Jakulin, A.
- Using Internet Pages of Organisations as Data Source for Social Science Research; 2008; Baumgarten, B., Grauel, J.
- Social Web Data as a Source for Social Science Research. The Example of a German Online Dating Website...; 2008; Skopek, J., Schmitz, A.
- DHS CAPI Data Collection Model Using PDAs; 2008; Rojas, G.
- The relative Coverage Error in Telephone Surveys caused by Mobile-Only Populations across Europe; 2008; Fuchs, M.
- Chaotic Web: The challenge of Misinformation and Disinformation; 2008; Keshavarz, H.
- Mixed methods in online evaluation: benefits and problems; 2008; Kuckartz, U.
- Use of the Internet as a data collection tool: a methodological investigation of online synchronous...; 2008; Evans, A. R., Elford, J., Wiggins, D.
- How can we convince the general public to respond to internet surveys?; 2008; Dillman, D. A.
- Nonresponse in web surveys within the context of survey errors and survey costs; 2008; Berzelak, N., Lozar Manfreda, K., Vehovar, V.
- The accuracy of online surveys with non-probability samples; 2008; Krosnick, J. A.
- The Danish time use and consumption survey 2008/9 - preliminary experiencies from applying a combined...; 2008; Bonke, J.
- On the feasibility of collecting biomarker data in an internet panel; 2008; Avendano, M., Mackenbach, J.
- Exploring the use of visual analog scales in web surveys; 2008; Couper, M. P.
- Internet access and cognitive ability: analysis of selectivity of internet interviews in the cognitive...; 2008; Willis, B.